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Box No. I Basis of the report 



□ 



1 . With regard to the language, this report is based on: 
the international application in the language in which it was filed 
a translation of the international application into 

which is the language of a translation furnished for the purposes of: — » 

I I international search (Rules 1 2.3(a) and 23. 1 (b)) 
I I publication of the international application (Rule 12.4(a)) 
I I international preliminary examination (Rules 55.2(a) and/or 55.3(a)) 

2. With regard to the elements of the international application, this report is based on (replacement sheets which have been 
furnished to the receiving Office in response to an invitation under Article 14 are referred to in this report as "originally filed" 
and are not annexed to this report): 



□ 



the international application as originally filed/furnished 
the description: 

pages 1-23 

pages* 



as originally filed/furnished 



received by this Authority on 
received by this Authority on 



the claims: 



pages* 



pages* 1-8 



pages* 



as originally filed/furnished 

as amended (together with any statement) under Article 19 

received by this Authority on 07-09-2005 

received by this Authority on 



□ 
□ 



the drawings: 
pages 1;>~ fQ 

pages* 

pages* 



as originally filed/furnished 



received by this Authority on 
received by this Authority on 



a sequence listing and/or any related table(s) - see Supplemental Box Relating to Sequence Listing. 
The amendments have resulted in the cancellation of: 

□ 
□ 
□ 
□ 
□ 



the description, pages 

the claims, Nos. 

the drawings, sheets/figs 

the sequence listing (specify): 



any table(s) related to the sequence listing (specify): 



□ 



This report has been established as if (some of) the amendments annexed to this report and listed below had not been 
made, since they have been considered to go beyond the disclosure as filed, as indicated in the Supplemental Box (Rule 
70.2(c)). 



□ 
□ 
□ 
□ 
□ 



the description, pages 
me claims, Nos. 



the drawings, sheets/figs 



the sequence listing (specify): 

any table(s) related to the sequence listing (specify): 



If iterrj ,4 applies, some or all of those sheets may be marked "superseded. " 
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Box No, V Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



1. Statement 

Novelty (N) 

Inventive step (IS) 

Industrial applicability (IA) 



Claims 
Claims 

Claims 
Claims 

Claims 
Claims 



1-36 



3. - 36 



1-36 



YES 
NO 

YES 
NO 

YES 
NO 



2. Citations and explanations (Rule 70.7) 

This report has been based on the amended claims filed with 
the letter of 07-09-2005. 

Documents cited in the International Search Report: 

Dl: US5444478 A 

D2: GB2354388 A 

D3: WO03041411 A 

D4: FR2696893 A 

D5: US5187571 A 

The cited documents represent the general state of the art. 
The invention defined in claims 1-36 is not disclosed by any 
of these documents. 

The cited prior art does not give any indication that would 
lead a person skilled in the art to the claimed method for 
generating a wide image video sequence, said method comprising 
the steps of: generating a set of calculated calibration 
parameters, related to a device having at least two video 
cameras which are arranged in a predetermined relationship to 
each other such that there will be an overlap between images 
from respective camera, said calculated calibration parameters 
being unique for the at least two cameras and their current 
location as related to the object being recorded; forming a 
synthetic image and identifying corresponding parts in 
overlapping parts of the image, and determining the relation 
between the respective coordinates for the pixels in the 
individual cameras and in the synthetic image; recording 
synchronously video sequences using each of said at least two 
video cameras; and generating a wide image video sequence from 
each of said synchronously recorded video sequences using said 
calculated calibration parameters. 

Therefore, the claimed invention is not obvious to a person 
skilled in the art. 

Accordingly, the invention defined in claims 1-36 is novel and 
is considered to involve an inventive step. The invention is 
industrially applicable. 
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Amended claims 05-09-01 0 7 -09- 2005 

1 . A method for generating a wide image video sequence, said method comprising the 
steps of : 

a. generating a set of calculated calibration parameters, related to a device having at least 
two video cameras which are arranged in a predetermined relationship to each other such that 
there will be an overlap between images from respective camera, said calculated calibration 
parameters being unique for the at least two cameras and their current location as related to 
the object being recorded; 

b. forming a synthetic image and identifying corresponding parts in overlapping parts of 
the image, and determining the relation between the respective coordinates for the pixels in 
the individual cameras and in the synthetic image, 

b. recording synchronously video sequences using each of said at least two video cameras, 
and 

c. generating a wide image video sequence from each of said synchronously recorded 
video sequences using said calculated calibration parameters. 



2. A method according to claim 1 in which the synchronously recorded video sequences 
are stored in a memory means. 

3. A method according to claim 1 in which the synchronously recorded video sequences 
are used concurrently for generating the wide image video sequence. 

4. A method according to claim 3 in which the wide image video sequence is transmitted 
live. 

5. A method according to claim 3 in which the wide image video sequence is stored on a 
memory means. 

6. A method according to claim 1 in which the generation of calibration parameters comprises 
the following steps: 

a. Start of calibration process; 

b. Synchronize the sequences from each camera, which means that at least a video 
sequence has to be recorded by all cameras; 

AMENDED SHEET 



7. 

10 



# u. Q 7 _Qg_ 2Qog 

c. Compute inter-image projective transformations; 

d. Use the transformations to refer each image to a common reference frame; 

e. Choose a real or virtual reference camera such that certain lines on the pitch and/or 
stadium are essentially horizontal and parallel in the wide image; 

f. Select a rectangular region of interest within the wide image. This region contains 
e.g. the entire pitch and as much of the stadium as is required or visible; and 

g. Record all computed values resulting from the calibration process to be used as the 
calibration parameters. 

A method according to claim 6 in which the steps of finding the lens distortion 
parameters) for each camera, and correcting radial distortion in each image produced 
are comprised. 

A method according to claim 6 in which the step of selecting non-linear distortion 
parameters to reduce perspective distortion of the wide image is comprised. 
Method according to claim 1 in which step b is performed manually by identification of 
corresponding features in concurrent video images and the coordinates for these 
corresponding features are input to a computer means. 
Method according to claim 1 in which step b is performed automatically by an 
algorithm for identification of corresponding features in concurrent video images and 
the coordinates for these corresponding features are input to a computer means. 
Method according to claim 1 which comprises the following steps: 
a. Apply the computed and registered calibration parameters. 

For each pixel in the wide image, compute and store parameters describing 

1. Which pixels from which image(s) contributes to this pixel in the wide image. 

2. How much these pixels each contribute to the wide image; 
25 b. Repeat until the end of the sequence is reached; 

c Obtain one new image from each camera; 

d. If required, update the parameters needed to transform intensities 
(colours/brightness) in one or more cameras to eliminate visible seams; 

e. If necessary, adjust the intensities (colours/brightness) in the images from one or 
30 more cameras: 

f. Create the current seamless, wide image from the current images from each 
camera; 

g. Output the wide image to a display or to a memory means; and 



15 

10. 

20 11. 
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h. End of sequence. Return to step b until end of generation of the wide image video 
sequence. 

12. Method according to claim 1 1 wherein the new images from each camera are read 
5 from live sources, each such source comprising a video camera. 

13. Method according to claim 1 1 wherein the new images from each video camera are 
read from a memory means. 

10 14. - In a device having a processor means, which executes instructions stored in at least one 
memory means, a method for generating video sequences comprising the steps of: 

a. generating a set of calculated calibration parameters, related to a device having at least 
two video cameras which are arranged in a predetermined relationship to each other such that 
there will be an overlap between images from respective camera, said calculated calibration 

15 parameters being unique for the at least two cameras and their current location as related to 
the object being recorded; 

b. forming a synthetic image and identifying corresponding parts in overlapping parts of 
the image, and detemining the relation between the respective coordinates for the pixels in 
the individual cameras and in the synthetic image, 

20 b. recording synchronously video sequences using each of said at least two video cameras, 
and 

c generating a wide image video sequence from each of said synchronously recorded 
video sequences using said calculated calibration parameters. 

25 1 5. In a device according to claim 14, the method in which the synchronously recorded video 
sequences are stored in a memory means. 

16. In a device according to claim 1 4, the method in which the synchronously recorded 
video sequences are used concurrently for generating the wide image video sequence. 



17. In a device according to claim 14, the method in which the generation of calibration 
parameters comprises the following steps: 
a. Start of calibration process; 
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b. Synchronize the sequences from each camera, which means that at least a video 
sequence has to be recorded by all cameras; 

c. Compute inter-image projective transformations; 

d. Use the transformations to refer each image to a common reference frame; 

5 e. Choose a real or virtual reference view such that certain lines on the pitch and/or 

stadium are essentially horizontal and parallel in the wide image; 

f. Select a rectangular region of interest within the wide image. This region contains 
the entire pitch and as much of the stadium as is required or visible; and 

g. Record all computed values resulting from the calibration process to be used as the 
10 calibration parameters. 

18 In a device according to claim 14, the method in which the generation of calibration 
parameters the following steps of finding the lens distortion parameter(s) for each 
camera, and correcting radial distortion in each image produced are comprised. 



15 



19 In a device according to claim 14, the method in which the generation of calibration 

parameters the following step of selecting non-linear distortion parameters to reduce 
perspective distortion of the wide image is comprised. 

20 20. In a device according to claim 14, the method in which step b is performed manually by 
identification of corresponding features in concurrent video images and the coordinates 
for these corresponding features are input to a computer means. 

21. In a device according to claim 14, the method in which step b is performed 
automatically by an algorithm for identification of corresponding features in concurrent 
video images and the coordinates for these corresponding features are input to a 
computer means. 

22. In a device according to claim 9, the method which comprises the following steps: 
30 a . Apply the computed and registered calibration parameters. 

For each pixel in the wide image, compute and store parameters describing 

1. Which pixels from which image(s) contributes to this pixel in the wide image. 

2. How much these pixels each contribute to the wide image; 
b. Repeat until the end of the sequence is reached; 



25 
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c. Obtain one new image from each camera; 

d. If required, update the parameters needed to transform intensities 
(colours/brightness) in one or more cameras to eliminate visible seams; 

e. If necessary, adjust the intensities (colours/brightness) in the images from one or 
5 more cameras; 

f. Create the current seamless, wide image from the current images from each 
camera; 

g. Output the wide image to a display or to a memory means; and 

h. End of sequence. Return to step b until end of generation of the wide image video 
10 sequence. 

23. In a device according to claim 22, the method wherein the new images from each 
camera are read from live sources, each such source comprising a video camera. 

15 24. In a device according to claim 22, the method wherein the new images from each video 
camera are read from a memory means. 



25. A computer readable memory means storing a program which executes the steps of: 

a. generating a set of calculated calibration parameters, related to a device having at least 
20 two video cameras which are arranged in a predetermined relationship to each other such that 

there will be an overlap between images from respective camera, said calculated calibration 
parameters being unique for the at least two cameras and their current location as related to 
the object being recorded; 

b. forming a synthetic image and identifying corresponding parts in overlapping parts of 
25 the image, and determining the relation between the respective coordinates for the pixels in 

the individual cameras and in the synthetic image, 

b. recording synchronously video sequences using each of said at least two video cameras, 
and 

c. generating a wide image video sequence from each of said synchronously recorded 
30 video sequences using said calculated calibration parameters. 

26. A memory means storing a program according to claim 17, in which the synchronously 
recorded video sequences are stored in a memory means. 
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27. A memory means storing a program according to claim 17, in which the synchronously 
recorded video sequences are used concurrently for generating the wide image video 
sequence. 



28. A memory means storing a program according to claim 1 7, in which the generation of 
calibration parameters comprises the following steps: 

a. Start of calibration process; 

b. Synchronize the sequences from each camera, which means that at least a video 
sequence has to be recorded by all cameras; 

c. Compute inter-image projective transformations; 

d. Use the transformations to refer each image to a common reference frame; 

e. Choose a real or virtual reference view such that certain lines on the pitch and/or 
stadium are essentially horizontal and parallel in the wide image; 

f. Select a rectangular region of interest within the wide image. This region contains 
the entire pitch and as much of the stadium as is required or visible; and 

g. Record all computed values resulting from the calibration process to be used as the 
calibration parameters. 

29. A memory means storing a program according to claim 28, in which the steps of 
finding the lens distortion parameter(s) for each camera, and correcting radial 
distortion in each image produced are comprised. 



30. A memory means storing a program according to claim 28, the step of selecting non- 
linear distortion parameters to reduce perspective distortion of the wide image is 
25 comprised. 



31. A memory means storing a program according to claim 28, in which step b is 
performed manually by identification of corresponding features in concurrent video 
images and the coordinates for these corresponding features are input to a computer 

30 means. 

32. A memory means storing a program according to claim 28, in which step b is 
performed automatically by and algorithm for identification of corresponding features in 
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concurrent video images and the coordinates for these corresponding features are input 
to a computer means. 



33. A memory means storing a program according to claim 28, which comprises the 
5 following steps: 

a. Apply the computed and registered calibration parameters. 

For each pixel in the wide image, compute and store parameters describing 

1. Which pixels from which image(s) contributes to this pixel in the wide image. 

2. How much these pixels each contribute to the wide image; 
10 b. Repeat until the end of the sequence is reached; 

c. Obtain one new image from each camera; 

d. If required, update the parameters needed to transform intensities 
(colours/brightness) in one or more cameras to eliminate visible seams; 

e. If necessary, adjust the intensities (colours/brightness) in the images from one or 
15 more cameras; 

f. Create the current seamless, wide image from the current images from each 
camera; 

g. Output the wide image to a display or to a memory means; and 

h. End of sequence. Return to step b until end of generation of the wide image video 
20 sequence. 

34. A memory means according to claim 28, wherein the new images from each camera 
are read from live sources, each such source comprising a video camera. 

25 35. A memory means storing a program according to claim 28, wherein the new images 
from each video camera are read from a memory means. 



36. A video recording apparatus for use in the method according to any of the claims 1-13 
comprising: 

30 a microprocessor^ 30), a memory means (120) for storing program for generating a set of 
calibration parameters related to a device having at least two video cameras which are 
arranged in a predetermined relationship to each other such that there will be an overlap 
between images from respective camera, said parameters being unique for the at least two 
cameras and their current location as related to the object being recorded; 
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said apparatus arranged to record synchronous video sequences using each of said at least two 
video cameras, and forming a synthetic image and identifying corresponding parts in 
overlapping parts of the image, and determining the relation between the respective 
coordinates for the pixels in the individual cameras and in the synthetic image, 
said memory means (120) also storing program for recording of wide image video sequences; 
read and write memory means (140) for storing data relating to recorded video sequences 

from at least two video cameras; 
input means (300) for input of manual input of parameters, input of recorded video sequences, 

and output means (300) for output of a wide image video sequence. 



10 
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